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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
fortli in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 8/8/07 
has been entered. 

Claim Rejections - 35 USC §112 

1 . The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact tenns as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of canrying out his Invention. 

2. Claim 1-38 rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the enablement requirement. The claim(s) contains subject matter, which was not 
described in the specification in such a way as to enable one skilled in the art to which It 
pertains, or with which it is most nearly connected, to make and/or use the invention. 
The limitations in claims 1, 16, 28 and 29, "Image stack comprising a stack of non- 
la vered . separate original images," fail to comply with the written description 
requirement. 

Claim Rejections - 35 USC § 101 

3. 35 U.S.C. 101 reads as follows: 
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Whoever Invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

4. Claims 28-38 are rejected under 35 U.S.C. 101 because the claimed invention Is 
directed to non-statutory subject matter. 

• In regards to claim 28, the claim limitation "computer readable-medium" is 
directed to non-statutory subject matter as described in the specification to be a 
"modulated data signal (page 11 paragraph 1)". 

• In regards to claims 29-38, the claim limitation " graphical user interface" 
not clearly defined, and therefore can be interpreted as directed towards non- 
statutory subject matter such as software. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill In the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a). the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant Is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
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consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e). (f) or (g) 
prior art under 35 U.S.C. 103(a). 

7. Claims 1 , 2, 4-6, 8, 1 0, 1 1 , 1 6, 1 9, 21 , 28, 29, and 30-32 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Beeman et al (hereinafter Beeman) 
US2003/01 90090, in view of Hsu et al (hereinafter Hsu) US Patent 6078701. 

• In regards to claims 1 , 16, 28 and 29 Beeman teaches a computer- 
implemented process, a system, computer-readable medium, and a graphical 
user interface for creating a composite image, comprising using a computer to 
perfonn the following process actions: inputting an image stack comprising a 
stack of non-layered, separate original images, each original image taken at a 
distinct separate time from the same point of view; applying one or more filters to 
the image to create one or more new intermediate images; selecting one of the 
original images in the image stack or an intermediate image as a source 
image(page 4 paragraphs [0042]-[0047]); and selecting pixels (page 5 
paragraphs [0068] and [0069]) from the source image to be added to a 
composite image to create a final composite image. However, Beeman does not 
specifically teach wherein the pixel position of each original image in the image 
stack is defined in a three dimensional coordinate system, and wherein two 
dimensions describe the dimensions of each image in the image stack, and the 
third dimension describes the time an image was captured. 
Hsu teaches a method and apparatus for performing local to global multiframe 
alignment to construct mosaic images. Hsu further teaches wherein the pixel 
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position of eacli original image in the image stack is defined In a three 
dimensional coordinate system, and wherein two dimensions describe the 
dimensions of each image in the image stack, and the third dimension describes 
the time an image was captured (column 18 lines 30-46 and column 16 line 44- 
column 17 line 9). It would have been obvious to one of ordinary skill In the art at 
the time of the invention to modify the method and apparatus of Beeman to 
include the time of Image capture In order to create three dimensions out of a 
two-dimensional image stack. One would have been motivated to make such a 
combination In order to create a three dimensional Image out of a two- 
dimensional image stack, based on time of image capture. 

• In regards to claim 2, Beeman teaches the above limitations (see claims 1 , 
16, and 29). Beeman further suggests wherein the process action of inputting an 
image stack comprises inputting an image stack wherein said original images are 
defined In a Cartesian coordinate system (page 13 paragraph [0220]). 

• In regards to claims 4 and 1 9, Beeman teaches the above limitations (see 
claims 1,16, and 29). Beeman further teaches wherein said process action of 
applying a filter comprises applying a median filter that returns the median pixel 
luminance along a span of the image stack, wherein a span is a set of image 
pixels at the same location in all images of the image stack (page 5 paragraph 
[0064]). 

• In regards to claim 5, Beeman teaches the above limitations (see claims 1 , 
1 6, and 29). Beeman further suggests wherein said process action of applying a 
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filter comprises applying a maximum histogram filter that returns the pixel with 
the minimum sum of squared distances in red, green, blue color space to all 
other pixels along a span of the image stack, wherein a span is the set of image 
pixels at the same location in all images of the image stack (page 5 paragraph 
[0064]). 

• In regards to claim 6, Beeman teaches the above limitations (see claims 1 , 
16, and 29). Beeman further suggests wherein said process action of applying a 
filter comprises applying a minimum histogram filter that returns the pixel with the 
maximum sum of squared distances in red, green, blue color space to all other 
pixels along a span of the image stack, wherein a span is the set of image pixels 
at the same location in all images of the image stack, (page 5 paragraph [0064]). 

• In regards to claims 8 and 21 , Beeman teaches the above limitations (see 
claims 1,16, and 29). Beeman further teaches wherein said process action of 
applying a filter comprises applying a maximum contrast filter that returns the 
pixel that has the highest contrast in a small neighborhood around it along a span 
of the image stack, wherein a span is the set of image pixels at the same location 
in all images of the image stack (page 5 paragraph [0055]). 

• In regards to claims 10, Beeman teaches the above limitations (see claims 
1,16, and 29). Beeman further teaches wherein said process action of applying a 
filter comprises applying a temporal smoothing filter that returns a weighted blend 
of a current image and the images before and after it, for a given span of the 
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image stacl<, wlierein a span is the set of image pixels at the same location in all 
images of the image stacl< (page 8 paragraph [0107]). 

• In regards to claim 1 1 , Beeman teaches the above limitations (see claims 
1,16, and 29). Beeman further teaches wherein said process action of applying a 
filter comprises applying a temporal sharpening filter that retums a pixel in the 
current image modified by the difference of the pixels in the images before and 
after the cun-ent image for a given span of the image stack, wherein a span is the 
set of image pixels at the same location in all images of the image stack (page 6 
paragraph [0075]). 

• In regards to claim 30, Beeman teaches the above limitations (see claims 
1,16, and 29). Beeman further teaches wherein said user creates said 
intermediate image by applying at least one filter to the image stack and users 
said intermediate image as a source image (page 4 paragraphs [0042]-[0047]). 

• In regards to claim 31 , Beeman teaches the above limitations (see claims 
1,16, and 29). Beeman further teaches wherein parts of said source image are 
transferred to said composite Image by transferring pixels from the source image 
to the composite image (page 5 paragraphs [0068] and [0069]). 

• In regards to claim 32, Beeman teaches the above limitations (see claims 
1,16, and 29). Beeman further teaches wherein said transfer of pixels from said 
source image to said composite image is based on a one-to-one con^espondence 
regardless of whether the user initiates pixel transfer from the source image or 
the composite image (page 5 paragraphs [0068] and [0069]). 
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8. Claims 7, 9, 12, 13, 18, 20, 22, 23, and 33-37 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Beeman and Hsu in view of "Photoshop 3," by 
Dayton et a! (hereinafter Dayton). 

• In regards to claims 7 and 20, Beeman and Hsu teach the above 
limitations (see claims 1 , 4, 8, 10, 1 1 , 16, 19, 21 , 28, 29, and 30-32). However, 
Beeman and Hsu do not specifically teach wherein said process action of 
applying a filter comprising applying a maximum luminance filter that retums the 
pixel with the maximum luminance along a span of the image, wherein a span is 
the set of image pixels at the same location in all images of the image, 
Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein said process action of 
applying a filter comprising applying a maximum luminance filter that retums the 
pixel with the maximum luminance along a span of the image, wherein a span Is 
the set of image pixels at the same location in all images of the image (pg.140). 
It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the method and apparatus of Beeman and Hsu to include the 
teachings of Dayton in order have a maximum luminance filter. One would have 
been motivated to make such a combination in order for the user to maximally 
enhance their digital photos. 

• In regards to claim 9, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein said small neighborhood is 5 by 5 pixels. 
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Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein said small neighborhood is 5 
by 5 pixels (pg. 83). It would have been obvious to one of ordinary skill in the art 
at the time of the invention to modify the method and apparatus of Beeman and 
Hsu to include the teachings of Dayton in order to have a defined neighborhood 
of filtering. One would have been motivated to make such a combination in order 
for the user to maximally enhance their digital photos. 

• In regards to claim 12, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein said process action of applying a filter 
comprises applying a high dynamic range filter that combines different exposures 
over a span of the image, wherein a span is the set of image pixels at the same 
location in all images of the image. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein said process action of 
applying a filter comprises applying a high dynamic range filter that combines 
different exposures over a span of the image, wherein a span is the set of image 
pixels at the same location in all images of the image (pg. 76). It would have 
been obvious to one of ordinary skill in the art at the time of the invention to 
modify the method and apparatus of Beeman and Hsu to include the teachings of 
Dayton in order to have a high dynamic range filter. One would have been 
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motivated to make such a combination in order for tine user to maximally 
enhance their digital photos. 

• In regards to claim 13, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein the high dynamic range filter extracts 
exposure information associated with the original images that comprise the 
image. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein the high dynamic range filter 
extracts exposure information associated with the original images that comprise 
the image (pg. 76). It would have been obvious for the reasons stated above (see 
claim 12). 

• In regards to claim 18, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein said module to apply a filter applies a high 
dynamic range luminance filter that comprises sub-modules to: compute a 
radiance value for each pixel in said image; map the radiance value for each 
pixel to its luminance value by mapping red, green and blue channels to a display 
to match the luminance. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein said module to apply a filter 
applies a high dynamic range luminance filter that comprises sub-modules to: 
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compute a radiance value for each pixel in said image; map the radiance value 
for each pixel to its luminance value by mapping red, green and blue channels to 
a display to match the luminance (pg. 76). It would have been obvious for the 
reasons stated above (see claim 12). 

• In regards to claim 22, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein said module to apply a filter applies a high 
dynamic range filter that comprises sub-modules to: compute a radiance value 
for each pixel in said image stack; map the radiance values for each pixel back to 
a set of display values via a tone-map. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital Images. Dayton further teaches Dayton teaches wherein said module 
to apply a filter applies a high dynamic range filter that comprises sub-modules 
to: compute a radiance value for each pixel in said image; map the radiance 
values for each pixel back to a set of display values via a tone-map (pg. 76). It 
would have been obvious for the reasons stated above (see claim 12). 

• In regards to claim 23, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10. 11. 16, 19, 21, 28, 29. and 30-32). However. Beeman and 
Hsu do not specifically teach wherein said tone-map is user- defined. 

Dayton how to use Photoshop 3. where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein said tone-map is user- 
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defined (pg. 76). It would have been obvious for the reasons stated above (see 
claim 12). 

• In regards to claims 33 and 35, Beeman and Hsu teach the above 
limitations (see claims 1, 4, 8. 10, 11, 16, 19, 21, 28, 29, and 30-32). However, 
Beeman and Hsu do not specifically teach further comprising a paintbrush 
function that transfers some pixels from said source image to said composite 
image. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches further comprising a paintbrush 
function that transfers some pixels from said source image to said composite 
image (pg. 176). It would have been obvious to one of ordinary skill in the art at 
the time of the invention to modify the method and apparatus of Beeman and 
Hsu to include the teachings of Dayton In order to have a paintbrush function for 
pixel transfer. One would have been motivated to make such a combination in 
order to for the user to maximally enhance their digital photos. 

• In regards to claim 34. Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein a radius of pixel transfer is user defined. 
Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images. Dayton further teaches wherein a radius of pixel transfer is 
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user defined (pg. 83 and 140). It would have been obvious for the reasons stated 
above (see claim 9). 

• In regards to claim 36, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein scaling the source Image or the composite 
image scales paintbrush function. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images Dayton further teaches wherein scaling the source image or 
the composite image scales paint brush function (pg. 76). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify the 
method and apparatus of Beeman and Hsu to include the teachings of Dayton in 
order to have a scaling function for a paint brush and source image. One would 
have been motivated to make such a combination In order to for the user to 
maximally enhance their digital photos. 

• In regards to claim 37, Beeman and Hsu teach the above limitations (see 
claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32). However, Beeman and 
Hsu do not specifically teach wherein a highest resolution image available is 
used when transferring pixels using the paintbrush function even when the 
source image or composite image is scaled. 

Dayton how to use Photoshop 3, where the user can enhance, edit, manipulate, 
etc. digital images Dayton further teaches wherein a highest resolution image 
available is used when transferring pixels using the paintbrush function even 
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when the source image or composite image Is scaled (pg. 35). it would have 
been obvious for the reasons stated above (see claims 33 and 35). 
9. Claims 3 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Beeman and Hsu as applied to claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 
above, and further in view of Jodoin et al (hereinafter Jodoin), US Patent 5493419. 

• In regards to claim 3, Beeman and Hsu teach the above limitations in the claims 
above (see claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 supra). 
However, Beeman and Hsu do not specifically teach wherein said process action 
of applying a filter comprises applying a slice filter wherein said filter retums an 
image in said image stack. 

Jodoin teaches stacl< filters for 1-to-N bit image processing in electronic printers. 
Jodoin further teaches wherein said process action of applying a filter comprises 
applying a slice filter wherein said filter retums an image in said image stack 
(Abstract). It would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the method and apparatus of Beeman and Hsu to 
Include a slice filter. One would have been motivated to make such a 
combination in order to use the filter to better format the image. 

• In regards to claim 17, Beeman and Hsu teach the above limitations in the claims 
above (see claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 supra). 
However, Beeman and Hsu do not specifically teach wherein said module to 
apply a filter applies a slice (x,y) filter wherein for each (x, y) said filter returns a 
pixel at depth z from said image stack. 
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Jodoin teaches stack filters for 1-to-N bit image processing in electronic printers. 
Jodoin further teaches wherein said module to apply a filter applies a slice (x,y) 
filter wherein for each (x. y) said filter returns a pixel at depth z from said image 
stack (Abstract). It would have been obvious for the same reasons stated above 
(see claim 3 supra), 

10. Claims 14, 26,and 27 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Beeman and Hsu as applied to claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 
above, and further in view of Okamoto et al (hereinafter Okamoto), US Patent 5754618. 
• In regards to claims 14 and 26, Beeman and Hsu teach the above limitations in 
the claims above (see claims 1 , 4, 8, 1 0, 1 1 , 1 6, 1 9, 21 , 28. 29, and 30-32 
supra). However, Beeman and Hsu do not specifically teach wherein said 
process action of applying a filter comprises applying a surface filter that 
operates on a given surface through the image stack. 
Okamoto teaches an image processing apparatus and method for favorably 
enhancing continuous boundaries, which are affected by noise. Okamoto further 
teaches said process action of applying a filter comprises applying a surface filter 
that operates on a given surface through the image stack (column 19 lines 12- 
21 ), It would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify the method and apparatus of Beeman and Hsu to include 
a surface filter in order to filter via surface of the image. One would have been 
motivated to make such a combination in order to use the filter to better format 
the image. 
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• In regards to claim 27, Beeman and l-isu teacti tlie above limitations in the claims 
above (see claims 1 , 4, 8, 1 0, 11 , 16, 19, 21 , 28, 29, and 30-32 supra). 
However, Beeman and Hsu do not specifically teach wherein said surface 
embedded in the image stack is user-defined. 

Okamoto teaches an image processing apparatus and method for favorably 
enhancing continuous boundaries, which are affected by noise. Okamoto further 
teaches wherein said surface embedded in the image stack is user-defined 
(Abstract). It would have been obvious for the reasons stated in the above claim 
(see claims 14 and 26 supra). 
1 1 . Claims 1 6, 24 and 25 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Beeman and Hsu as applied to claims 1 , 4, 8, 10, 1 1 , 16, 19, 21 , 28, 29, and 30-32 
above, and further in view of Chuang et al (hereinafter Chuang), "Video Matting of 
Complex Scenes". 

• In regards to claims 1 5, 24, and 25, Beeman and Hsu teach the above limitations 
in the claims above (see claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 
supra). However, Beeman and Hsu do not specifically teach wherein said 
process action of applying a filter comprises applying a mat filter that produces a 
mat of a given portion of the image stack, wherein the mat is an image of 
transparency values that will modify the source image when it is used for creating 
said composite image. 

Chuang teaches video matting of complex scenes. Chuang further teaches 
wherein said process action of applying a filter comprises applying a mat filter 
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that produces a mat of a given portion of tlie image stack, wlierein the mat is an 
image of transparency values that will modify the source image when it is used 
for creating said composite image (page 1 , introduction). It would have been 
obvious to one of ordinary sl<ill in the art at the time of the invention to modify the 
method and apparatus of Beeman and Hsu to Include a mat filter to manipulate 
the background and foreground. One would have been motivated to make such 
a combination in order to use the filter to better format the Image. 
12. Claim 38 is rejected under 35 U.S.C. 103(a) as being unpatentable over Beeman 
and Hsu as applied to claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 above, and 
further in view of Funayama et al (hereinafter Funayama), US Patent 6389155. 

• In regards to claim 38, Beeman and Hsu teach the above limitations In the claims 
above (see claims 1, 4, 8, 10, 11, 16, 19, 21, 28, 29, and 30-32 supra). 
However, Beeman and Hsu do not specifically teach further comprising a paint 
brush function that transfers all pixels associated with a face from said source 
image to said composite image when said paint brush function is used to select a 
portion of said face. 

Funayama teaches an image processing apparatus. Funayama further teaches 
further comprising a paint brush function that transfers all pixels associated with 
a face from said source image to said composite image when said paint brush 
function is used to select a portion of said face (Figure 4). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify the 
method and apparatus of Beeman and Hsu to Include transferring all pixels 
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associated with a face from said source image to said composite image when 
said paint brush function is used to select a portion of said face in order to select 
a portion of the face. One would have been motivated to make such a 
combination in order to better format the image. 

Response to Arguments 
Applicant's arguments with respect to claims 1-38 have been considered but are 
moot in view of the new ground(s) of rejection. 
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Conclusion 



Any inquiry concerning tliis communication or earlier communications from the 
examiner should be directed to Shashi K. Becker whose telephone number is 571-272- 
8919. The examiner can normally be reached on Mon-Frl 8:30-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wellun Lo can be reached on 571-272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more Infomnatlon about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would Wke assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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